Optimization of Quadtree Segmentation and Hybrid 2D and 3D Motion Estimation in a Rate-Distortion Framework

A rate-distortion framework is used to de ne a very low bit rate coding scheme based on quadtree segmentation and optimized selection of motion estimators. This technique achieves maximum reconstructed image quality under the constraint of a target bitrate for the coding of the vector eld and segmentation information . First, a complete scheme is proposed for hybrid 2D and 3D motion estimation and compensation. The quadtree object segmentation is optimized for hybrid motion estimation in the rate distortion sense. This scheme adapts to the depth of the quadtree and the technique used for motion estimation for each leaf of the tree. A more sophisticated technique, adapted to the requirements of a very low bit rate coder is also proposed which considers also the transmission of the prediction error corresponding to the particular choice of the motion estimator. Based on these coding schemes two versions of a very low bit rate image sequence coder are developed. Experimental results illustrating the performance of the proposed techniques in very low bit rate image sequence coding application areas are presented and evaluated.